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ABSTRACT 

An a.nalysis of portions/of the HumRRO ' (Human 
Resources Research Organiza.tion) developed computer-assisted 
instruction (CAI) course in cbBOL programing, and a survey of 
•representatives from Advanced .Research Project Agenpy (ARPA) PLATO IV 
installations indicated ^ need *f or authoring aids that could be 
.prepared and programed easily and quickly.' The nine HONIFOJ^MS 
rasulting . from this fetudy are useful for rapid development oj^ certain 
frequently *used CAI material. These authoring aids are partially 
pfecoded formats which make* use of HuipERO subroutines for question 
execution. ftONIFORMS are used -for deve^lo'pment of single questions — of 
the multiple choice, constructed response, and matching type — that 
can be combined with material prepared by conventional methods. The 
c?haracteristics of these MONIFORHS are described toge^bher with ' 
comments on future devel^>pments to be made in CAI material generation 
for ;nilitary training. (A\ithor/DGC) • , ' » , 
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human performance, particularly in organizational settings, throu^ behavioral 
and social ^ience research, development, and consultation^^HumRRO's^mission 
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of the ^^Army is to conduct research^ in tbe'^elds of training, motivation, 
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These authoring aids are- partially preceded formats which make use of 
HuraRRO 'subroutines for question execution. MONIFORMS are used for 
development of single questions--jof the multiple choice, constructed 
response,' and matching tyfie-that can be combined with material prepared* 
by conventional methods, they are responsive to users' needs, cover most 
of the frequently used question typfes, reduce preparation? time, do not 
require TUTOR programming experience for their completion, combine readily 
with conventionally coded material, and are econonjtcal with author- 
computer lesson space. Future MOMi FORM activity will include incre^mg 
their number and variety, and developing a second gerieration type 
MONIFORM. . \ . . 
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BACKGROUND 

There is increasing evidence that computer-administered instruction (CAI) is a 
promising approach to meet the new training problems posed by a smaller, all-volunteer 
Army. CAI, however, is an^ expensive training medium in terms of inputting quality 
instructional material into the system, from both the standpoint of time and require- 
ments for programming skill. 

This report documents research conducted under Work Unit CATALIST in 
developing ' authoring aids (MONIFORMS) for preparation of frequently -used qaestil)n 
types in CAI lefeson material for the PLATO IV CAI system. These authoring aids greatly 
reduce the time required for question preparation and require no knowledge of the 
TUTOR programming l&iguage.^ ' 

PRODUCTS 

Nine MONIFORMS have been completed and are presently iji use by military 'and 
civilian PLATO authors for developing multiple choice,, constructed response, and 

.matching- type questions. Essentially, MONIFORMS are partially precoded formats which 
make use of HumRRO subroutines for (fUestion execution. Authors provide only textual 
material and feedback messages for their questions, and information about the way they 
wisji a. student's response to the question analyzed, A typical question can be developed 

Jn ip-15 minutes using a MONIFORM, compared to 2-6 hours using conventional 
methods of preparation, MONIFORMS are used for the development of single questions 
that can be combined with material prepared by conventional methods. Therefore, 
MONIFORMS dp not dictate the overall structure of an author's lesson. 

An introduction and 'guide to the use of MONIFORMS (Lesson MONIFORM) are 
available, in a CAI version on the PLATO system afid in a programmed text version, for 

' use by any interested author.^' < 



^ *Russei E. Schulz. Lesson MONIFORM, An Authoring Aid for Uw PLATO IV CAI Syslenu 
HumRRO Research Product RP-ED-75-6, April 1975. 0 
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PLICATIONS 

It; has been demonstrated that the nine available MONIFORMS are useful tools for 
rapid development of certain frequently used CAI material. There is a need for con- 
tinuing activity -in MONIFORM development in the following areas: , * \ 
(1) To increase the catalog of MONIFORMS to include other question types 
* and alternate. means of accepting stiraents' responses, ' 

1(2) To develop MONIFORM data collection packages. 
. (3) To increase the length of feedback messages permitted. 
' (4) To develop a second generation type MONIFORM in which PLATO 
requests information from the author that can be automatically converted to execjj- 
table code. 




^ . 7 PREFACE, \ ^ 

This report describes the development 6f Work Unit 'CATALIST authoring aids 
(MONIFORMS) for the PLATO IV coftiputer-administered instruction (CAI) system. The 
research objectives, procedure, results, and implications for further research are discussed, 
A companion document. Lesson MONIFORM, An Authoring 4id for the PLATO IV CAI 
System, HumRRO Research Product RP-ED-75-6, provides descriptions of developed 
.MONIFORMS and*detailed'|fuidanc§ to users for MONIFORM completion. 

The work was conducted at HumRRO Eastern Division, (Alexandria, Vitginia, Dr. J. 
Daniel Lyons, Director. Dr. Rgbert J. Sefdel is the Program t)irector for Work Unit 
CATALIST. Mr. Russel E. Schulz is primarily responsible- for the MONIFORMS research. 
Assistance was provided by HumRRO researchers^Dr. Harold Wdgner^ Michael Hillelsohn, 
♦Richard Rosenblatt, Nancy Hibbits, Carol Kastner, Judith Compton, Theodore Rosen, 
William Underbill, Patricia Hasty, and SP/4 John Volk. 

Appreciation is extended to iniiividuals at the various Advanced Research Project' 
Agency (ARPA) PLATO installation sites for survey information provided and for their 
interest, in MONIFORM development'. Also, individuals at the University of 'Illinois 
Computer-Based Educational Research Laboratory, and especially H.A. Himwich and Dr. 
L.D. Francis, provided invaluable assistance ^in the development o3f individual 
MONIFORMS. . . 

HumRRO' research for the Department of the Army "under W6rk Unit CATALIST is 
performed under Army Contract DAHC19-73-C-0004. Computer-administered instruction 
research is conducted under Army Project 2Q763731A734. The CATALIST work is 
conducted under the sponsorship of the^U.S. Army Research Institute for the Behavioral 
and Social Sciences, with Dr. Joseph S. ward serving as the technical monitor. v,' 



Mereditli P. Crawford 
President 

Human Resources Research Organization 
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INTRODUCTIpN 



BACKGROUND- / ' . « 

The' <:ombmation of shrinking fmancial resources aiid the prospects of a smaller, 
all-volunteer Army ^wilf increase the demands made on Army-3^rsonnel andi the 
importance of the individual soldier. There ^^will be a greater need for more effective and 
efficient tiaining, adequate to the .task of providing jan increasing number of complex 
skills to widely differing students, with' fewer skilled instructors. ' 

There, -is mounting , evidence that computer-administered instruction (CAI) is the 
most promising approach a^vaila.ble td meet thfise new training demarias. , 

The HumRRO Instructional Technolo©^ Group (ITG) has been active in GAI 
^research and development since 1968. (See Appendix A.) MONIFORMS ( Monit oring. 
Form ats) are designed for use on the' PLATO IV TIAl system and represent HumRRO's 
continuing research effort to develop advanced authoring aids. ^ - 

PROBLEM • ' ' : ' - 

, *the development pf quality instructional hiaterials is a major cost that must be 
considered when implementing any •CAI system. Obviously, the quality of instruction 
received by a CAI student will depend primarily upon the quality of the instructional 
material' inputted into the computer. Further, the preparation of quality material required* 
considerable time and skilly Both of these factors are frequently in short' supply at many 
CAI installations. f ^ ' , 

The PLATO' IV CAI system is' a highly sophisticated system th^it permits greater 
innovativg freedom in the instructional . methodology used than do many other CAI 
systems. Because of its sophistication, the quality of instruction that may be presented 
on PLATO IV, is limited only by the. imagination and skill of the individual author and/or 
TUTOR prograntoer. This grater freedom, however, frequently results in increasing the 
cost of producing instructional material. That is, the cost In terms of time and skill 

. requirements is generally positively related to the complexity and sophistication of the 
instructional material being prepared. *• . - 

Therefore, an important goal for CAI research is to find ways iti which the 
authoring and pro^mming^ processes can be accomplished mote easily and quickly while 

. a high quality of instruction is maintained. The development of effective authoring aids 
can make a significant cofttribution to the accomplishment of this goal. The HiynRRO- 
developed MONIFORMS are one type of authoring aid that holds considerable pfomis^. 
Efeentjially, MONIFOR^MS are partially ^precoded formats. They are designed to assist in 
the preparation of certain .types of instructional , material for monitoring student 
performance and to provide immediate assistance to students whose performance is, found 
to be deficient. / ' ' , ^ 

STAFF TRAINING * . . / . * ^ ^ 

In preparation for the development of MONIFORMS, three scientists from the ITG 
visited the .University of Illigiois Computer-Based Educational Research Laboratpry' 



(CERL) for a one-week tnuning program in the TUTOR programming language. The 
SlONIFORM project leader remained at CERL for an additional month' of advanced 
oii-the-job-training. Upon his return from CERL, an off-line 'TUTOR training program w^ 
prepared and administered to the remaining ITG staff. ^ This training was initially 
administered off-line since the delivery of the PLATO IV terminals to HumRRO was 
greatly delayed, and the' research time schedule did not permit waiting' for their arrival 
for.the staff to begin taralning. * • . 

RESEARCH OBJECTIVES 

Six major objectives were established for the development of M0(NIFORMS: . 

(1) MONIFORMS must be responsive to' the tjreeds of PLATO IV users, 
especially th|pse at ^ military CAI installations. ^ 

(2) MONIFORMS must be prepared only for frequently used types 6t*^ 
instruction in which ttie bal^ic code is essentially the same, independent of the external 

' characteristics of the material. For example, the code necessary for any multiple choice 
question is basically the same, independent of such variables as the^^ textual coi;itent, 
nHmber of answer alternatives, feedback mess^es, and placement on the screen. . 

(3) MONIFORMS; must j^etmit significantly more T^id preparatio'i^ of 
instructional material than do conventional methods or preparation.-^ 

(4) MONIFORMS must be usable to authors and prognunmers with lunited * 
experience with the PLATO IV system and the TUTdR programming language, as well as 
to^he- more experienced author and programmer. , ^ i ^ 

(5) MONIFORMS mtist have the. capability of producing ^material that can be 
combined with material prepared without MONIFORMS. It is unlikely that MONIFORMS 
meeting all authors' total requirements ..cpuld , ever be developed. Therefore, the total 

* instructional package shoHid have production capabilities with material prepared witk^ 
both MONIFORMS and conventional methods. C ^ / - . / 

(6) MONIFORMS must fae econbmical with the author^s computer lesson space. 
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' Selected in diVi duals from the staft^ere later used to qompare the preparation time required 
' for ' matei^iai prepared with and without MONIFORMS. Trainiitg consisted of a series of practice 
> problems sii^ilar-to those used at CEF^t.. While these prqbl^pis were designed to fulfill specific ITQ staff 
training. iffequirenrrents, they are available .^b' other interested indivi^ilais u)>on request: ^ 



PROCEDURE 

IDENTIFICATION OF MATERIAL SUITABLE I^R M ONI FORMS * 

As a first approach to identifying material that w6uld' lend itself to MONIFORM 
preparation, selected portions of the HumRRO-developed CAI course in COBOL Pro- 
gramniing^ were carefully screened and each question contained in the material was 
displayed on flow charts. The flow charts showed that from approximately 20Q different 
questions, all could be prepared with approximately 15 different coding formats. Further- 
more, the num^ier of question typ'es^ that could be handled by the sjime basic pro- 
gramming code, and the frequency of theif use, were 'sufficient to justify the^develop- 
ment of MONIFORMS to assist in the preparation of simi^^o: types of questions. From 
^the screening, an initial list of question types that woujd lend themselves to 
MONIF^ORMS was prepared. These were multiple choice, constructed response, and 
matching-type qdestions. * ^ . ^ 

To ensure that the approach was responsive to PLATO military users' needs,"* a 
survey was ^conducted in January 1,974, of representatives from Advanced Research 
Project Agency (ARPA) PLATO IV installations. In some cases, instaUlations duplicated 
. the survey form and had more than one member of their slj^f complete a fojr^i. Twelve 
installati?)ns were represented in the. survey. From these installations, 16' survey ^rms 
were returned. . ' 

The survey results support the need for MONIFORMS of the type established in the 
screening of the HumRRO COBOL CAI program and provide information about military, 
authors and programmers useful in MONIFORM development. 

Appendix B shows the ARPA installations surveyed; and Appendix C shows .the 
ta.bulated survey responses for questions of concern to this study. Four, of the installa- 
tions surveyed did not have PLATO terminals and therefore rfetuTried, the sutvey. 
unanswered. Some individuals did not complete every question. Therefore, the numbej 
(N) for each question ranged from 742. Admittedly, ,$his is a smajl* N, but %e data do 
provide useful information. The results can be summarized as follows: _ 

(1) A period of 20 weeks was the tneaxi number of jiveeks of experience with 
the PLATO system that the average author required in order to take advantage of most 
of the capabUities of ?he. system. This is a considerable expense. Authoring aids, which 
require less TUTOR programming experience, can help to reduce this expense. 

(2) Eight of ten individuals responding to the applicable question reported that 
7^5:100% of the coding commands necessary for on line implementation of CAI mdteri^* 
is coded by the authors themselves. • * ^ . * * 

^ . (3) Ten of the twelve individual^, responding reported tHey make 'extensive use 
of practice questions as a means of n^ionitoring and shaping student performance. Multiple 
choice questions were reported as the iqost fre^quently used type of question for this 
purpose (62%). ^ . ' 

j(4) Almost fUl respondents reRprted that available time and TUTOR pro-* 
gramming expegrience seriously affect the number and complexity of practicie. questions 

, ^ The C^B0HL2 course develop|d by HumHRO under Work Unit IMPACT/CATA'LIST consists of 
fnicrofiche that contains -lext, ,4^e student refe^rence manual (125 pa^es^, and a 35mm film striy of 
auxiliary visuals. 7 • . ^ 
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/and response analysis strategies prepared at their installations. Effective authoring aids can . 
' reduce thp time required for preparation 6£ routine questions and-shpuld therefore 
provide additional preparation time for more complex questions and/or time for studymg 
, ' TUTOR programming, * - . , • ' 

. (6) Authoring aids would be most \is6ful for the preparation of multiple choice 
^ questiops[ foUowiBd by ccuistrficted respohse arid matchipg4y^ * 

monif6rivi devjeCopment ■ '■' . , 

' 'i> The typicai stejjs^en in the dev«lopmenJ; of each MQNIFORM were as follows: . 

(I) Initio listing of charafcteristics^thpaM^o be desirable for the question 
,.jtype under considerktio;i, (Wlf^HilK^al MdNiFORM do?) 

* (2) Review of these characteristici|||P|easrotf ^ to.feasibiUty of inclusion m 
^ the l5(ONI^0RM/ ; ' ^ ' ^ . V, v 

,4. (3) Finalizing the list of Characteristics., ' * . 

(4) Preparation 9f a working copy flow chart for^th:e response analysis capabili- 
/ ' . ' ? ties of the question type. , ^ / ^ 

* » * • (5) Examination of subroutines used fiT previous MONIFORMS to determine 
' their applicability in the MONIFGRM' under develppment. * « 

* (6) Preparation of initial TUTOR codjmg fotithe MONIFORM, . ' 

' (7) Testing and revision of initial coding forproper question execution. 

(8) Decision as to which portiort of the initial coding should be .included^ in the 
i MONIFOkM and which portion should "be' included in HUmRRO 

subroutines. ' . • * -'^ * 

(9) Preparation of c^ructions ior user completion of the MONIFQRM. 

" ' ^ (10) Trycfut of 'l^ONIFQRM lor question prepatation by , selected members of 
. ' the CATALIST staff . ^ * a ^ ^ ' ^ 

(II) Revision of tfode and instructions as necessary. 

(12) Release of the MONIFORM to.the general PLATO audii^nce. * 

(13) On-site intemews of MONIFORM lisers for thieir reactions, criticisms, 
* I and needs. ^"^ . *v v ^ ^ . ^ ^ 

^ (14) Refinement of the MONIFORM, • . ' - . 

■ ^Nine MQNIFORMS w§re developed and introduced* t9 military and -civilian PLATO 
Tjisere by me^s of .the,^ on-line PLATO comnfunicatign, system, ."Lesson NOTES," and 
•'Lesson arpafile.*** ; ^ . ^ . ^ ; - ^ , 

. Four of these MONIFORMS are lased for prepar^fion of multiple choice questions, 
three for preparation of -constructed resporis? questior^., ^d two ^^e used for preparation 
, of mat^hing-type questions. ATI of , the MONf^ORI^S offer the u^r considerable freedom 
'to individualize his particular qu^ions both in ^^Xtual content and in'methoU^ for 
. analyzing Students'" responses. For example, all of the MO^FORMS allow thp^ author to 
specifAihe number of ^^ttempts the student wiU be permitted to answer the questions 
and which one of three types of assistance the>.^udent vrill "receive when^the attempt 
.limit k reached. In two of the multiple choice MONIFORMS, ^answer alternatives .are 
. ' presented in random order and therefore provifie an unbiased methdd of, ordenng 
'answer alternatives. - . 

" All nine MONIFORMS provide for auth<?f .specified feedback messages. In some 
MONIFORMS the incorrect answer fe^backs may. be written tb deal with specific 
incorrect answers (responte specific feedbacks), ..whereas in others, the incbrrect answer 
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» Arpafile is ^ lesson designed for ARPA users' fgr documenting itJaterial of ^tential interest to 
other XRPA userii * ^ ♦ ' » 
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feedbacks are more general in* nature but may differ, depending upon the particular 
student attempt (general feedbacks). 

- Tables 1-9^ give' a brief descHption of the nine MONIFORMS.* 
Ta^le 10 is an example of an"^ uncompleted MONIFORM used for preparation of 
constructed respoi^se.. questions in which the u§pr may provide feedback m'essages for (a) a' 
correct answer, <b) anticipated wrong answers; or (c) unanticipated wrong answers. (See 
Table 7 for complete characteristics*.) To use this MONIFORM ap aythor would use the 
copy featupe of the PLATO" system to copy the MONIt'OEM info his lesson space. He» 
, would .then follow the instructions ^that appear ' in the' MONIFORM .after tfte double 
dollar signs ($$) to tailor the question to his specific retjuirements.^ Table 11 shows the 
same, MONIFORM as in Table 10, except that the' MONtFO?,M \s 'now completed to 
show a sample question. . . " ' - 

. Approximately 80-90% of the TUTOR code (sub;:outiries) necessary for execution of 
questions prepared with MO^nFORtMS* Yesides in HumREO lesson space and is available 
to all users for execution of all MQNIFORMS. An author n^er cc^ies this codle into his 
lesson space. To use thlN^.ode,*the author' copies unit ^*setup,'* shown ip Table 12, into * 
Ijis les^n one time^ only regardless df the number or ^ type of MONIFORMS used. 
Therefore, the only TOTOR code associated with a question prepared with MONIFORMS 
that tfeside^ in the* author's lesson space is unit '*,*setup" (one time only) and the 
completed laONIFDRM/^. ^ ; * 

LESSON MONIFORM ' ' . . ^ / 

! ~ — c ' ^ 

As each MONIFORM was d^eloped, it was immediately made available to all 
PLATO authors^ fin 'order, to .keep the authors informed of MONIFORM developmetit, a 
CAI lesson, lesson MONIFORM, was prepared. It has undergone three revisions. Readers 
wfio have a PLATO.' terminal available are encouraged to . examine this lesson.^ It is 
designed so that users have maximum freedom in branching to various subjects within the 
lesson. As a consequence, th^y need access only those section^* for which they, want 
specific inforn^afion. A brief description, of each of the sections in the lesson is shown in 
Appendix D. * . ' ' 

• ' The CAI version of Lesson I^ONIFORM is useful if the author has a PLATO 
terminal immediately ayailairle. However, some users of MONIFORMS may want to study 
MONI]?ORM use away from the .ternjinal. For this refiSbn, Lesson MONIFORM is also 
available in a hard-copy programmed text version."* Alio, while in the process of 
completing a MONIFORM, a - user may find it more^ cqiivenient to refer to the pro- 
'grammed tejt,t rather tharf the CAl versiop. The two versions therefore offer the user a 
choice of which he prefers to use. However, after an author has successfully completed a 
MONIFORM, he will probably require little assistance from the lesson for completion of 
successive MONIFORMS. . ^-^^ , ' . 

* A more complete description of HumRRO MONIFORMS is 0ven in Lesson MONIFORM, An 
Authoring Aid for the PLATO IV CAI System, by Russei E. ScIiuU, HumRRO Research Product 
RP'ED-75-6, April 1975. The reader may also refer to Lesson "moniform" on-line on the 
PLATO system. ' . - 

^Coding details are described in Usson MONIFORM, An Authoring Aid for the PLATO IV CAI 
System. (See previous footnote.) • * * • 

^ Sign into PLATO lesson mo ni form as a student . * - . 

• ^See HumRRO Research ?ro^uct Lesson MONIFORMS, An Authoring Aid for^he PLATO IV CAI 
f System, by Russei E.^hulz. Research Product Rt-ED-75-6, April 1976. 



Table 1 

MONIFORMl CHARACTERISTICS . 
(Multiple Cnoice) 

1 correct answer* (40 characters long) ^ 
1-4 distractors (40 characters long) 

Answer atterriatives t}resented in random order 

Option of having student's response judged imme- 
diately after he/she has enterec^it, or requiring the y 
Wudent to press the NEXT ke*before judging begins 

Author specified number of attempts student* Is 
allowed • ^ 

author specified correct answe^f feedback 
1-4 author specified general feedbacks 
Unanticipated response, feedback 

Author specifies type of assistance student receives 
'whpn try limit reached .(instructor is called, answer 
is given, or*rK> assistance is given) 

2 author specified branchifigunits* 



. . Tabre2 

M0N.IF0RM2 CHARACTERISTICS 
(Multiple Choice) 

7^ ~~ ~ 

All characteristics are identical to MONIfORMI except: 

MONIFORMl -answer alternatives presented in 
j-andom order 

M0NIF0RM2-answer presented in order speci- 
fied by auuior 
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■^-'J ■ table 3 



' M0NIF0RM3 CHARACTERISTICS 
* (Multiptd Choice) 

— 5 : — . 

' 1 correct^answer (40 fcharacters long) * * ' ♦ ' 

1-4 distij9ctor$ (4Q characters long) / . 

Answer alternatives presented in r^andom order. 

" Option of having studei^t's response judged imme* 
* diately after he/she has entered it, or requiring the 
student to press the NEXT kpy before judging begins 

Authpr specified number of attempts student is 
allowed ^ ' 

. 1 author specified oo/tect answer feedback 

1*5 response specific/ incorrect answer try again 
feedbacks * / 

Unanticipated response feedback 

^ /Uithor specifies type of assistance student receives 
when try limit reached (Instructoi^ is called, answer 
is ^iven, or no "assistance is given) . 

2 author specified branching units 
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• Table 4 , ^ ^ 

M0NIF0RM4,CHARACTERISTICS 
(Multiple Choice) 

All characteristics are identical to MONI FORMS except: 

MONIFORMS-answeryalternatiyes presented in 
♦ .random order ' ^ 

M0NlF0RM4-answer alternatives presented in 
order specified by author 
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\ .V* Table^ . 

V MONI^ORMS 9HARACTERISTICS ^ 
(Constnicted Retjponse) 



Synonymous answers {or, phrases) permitted 
Optional words permlttefl in answer 
I Author selected^spedificatioa for Judging of student 
answer using^the TUTOR-specs-command ' 
1 author specified correct answer feedbad^* 

Author specific number Of attempts student 
permitted* ^ ^ . ^ 

1-4 author specified ^neral (not response specific) 
incorrect answer 



citied oen 
Br tnf aga 



dgain feedbacks 

Unanticif«ed r^ponse feedback 

* Author specif fed ^pe of assistance student receives 
when try limit reached {instructor is called, answer 
is given, or no assistance is given) 

2 author specified branchinp unit^ 



Table 6 ^ - 

MONIFORMSCHARACTERISTICS 
(Constructed Response) 

Synonymous answers (or phrases) permitted 

Optional words permitted in answer 

Author selected gwcification for judging of student 
' answer using the TUTOR-specs^mmand . 

1 author specified correct answer feedback 
1-5 response specific incorrect answer try again 
feedbacks 

1 general incorrect answer try again feedback 

4 

Author specified number of attempts student 
permitted 

UnanticipataJ response feedbadp 

Atrthor specified type pf assistance student receives 
v/hen try limit reached (instructor is galled, answer 
• js given, or no assistance Is giv^n) . ^ 

2 author specified branching units 



\ TaWci 7 

MONIHdR^? CHAflACTERISt^CS 
(Consifucted Response) ' 



^ MONtFORM? is a^combmation of M0N1F0RM5 and M0N1F0RM6. 
That is, in MONl FORMS only Vgeneral" feedbacks (not response 
specific), are^esente^o the student for incorrect answers; in 
M0NtF0RM6 respon^>Hxfcific teedbacks are^lv^n* 

M0NIF0RM7 provides the student with both "general" and 
"response specific" feedbacks, ^ » ' 




/ 
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Tables 

MONI FORMS CHARACTERISTICS ^ 
(Matching) 

Maximum of 9 matching items permitted 

Matching answer alternatives presented in 
random order ^ ^ 

Student moves pointer to select match ' ^ 

After completing all matches/ student gtven oppor- 
tunity to change answers 

^Number of attempts at entire problem specified / 
author "1 ' 

MONtFORM provided feedback stating number of 
correct matches made on .each attempt * 

Author specified correct answer feedback 

Author specified type of assistance student receives 
when try limit reached (instructor is called, answer 
is given, or no assistance is given) 
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Table 9 



MONI FORMS CHARACTERISTICS 

(Matching) 



Maximum of 10 matching items permitted (order specified 
by author) ^ 

Single, double, or triple spacing permitted between 
matching items ' ^\ 

Graphic displays may be incorporated into irfatching 
problem 

Student permitted to match items in any order desired 

Student permitted to change answers before final judging 

^Number of attenrpts at entire problem specified by author 

Author specified correct answer feedback 

Student informed of specific incorrect matches made 

Author specified^ type* of ^istance student receives when 
try limit reached (instructor is called, answ^ is given, or 
no assistance is given) 
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Table 10 

MOfNlFORM? (Uncompleted) Constructed Response 



s 



un>t 
next 
define 
zero 
calc 
write 



caic 
vocabs 



pack 
pack 
p^1< 
pack 
pack 
pack 
p^k 
pack 
pack 
pack 
pack 
csUp 



form? 
nextu 
formi 

v{offset),88 

pos<}= 
< ax,pos> 
. $$ ^- 
$$ ^ 
$$ " 
Ijnes^ 
form? 

<2Z,ZZ,Z2> 

(catext^zzzz) 
{alt1,wrong1) 
{alt2,wrong2) 
(alt3,wrong3) 
{a]t4,wrong4) 
(alt5,wrong5) 
temp,catext, 
. temp,caf, 
temp,taf, 
temp,taf2, ' 
temp,taf3, 
temp,taf4, 
' temp,taf5, 
temp,waf, 
temp,waf2, 
temp,waf3, 
temp,waf4, 
ntaf 0 
notriesO' 
"bassist 0 



$$ r form? with your unit name * 
\ $$ r nextu with your next unit 
\$$:jCOpy as is . 

'$$copyasis ;^ — 

$$ add screen position to start 
, $$ add line 1 of question 
$$ r first $$ with line 2 of question . 
$$ r first $$ with line 3 of question 
$$ r first $$/with line 4 of question 
■ '$$ add # question lines used 

$$ r form? with your unit name 
, $$ r zz's with optional words v 
$$ r zz's with correbt answer 
$$ r wrong 1 with incorrect answer 1 
$$ r wrong 2 with incorrect answer 2 
$$ r wrong 3 with^fn correct answer 3) 
$$ r wrong 4 with incorrect answer 4 
$$ r wrong 5 with .incorrect answer 5 ' 
$$ add correct answer (one only) 
$$ add correct answer feedback 
$$ add feedback for wrong answer 1 
$$ add feedback -for wrong answer 2 
$$ add feedback for wrong answer 3 
$$ add feedback for wrong answer 4 
$$ add feedback for wrong answer 5 
$$ add general feedback 1 
$$ add general feedback 2 
' $$ add general feedback 3 
$$ add general feedback 4 
$$ add # of general fd|^)acks used * 
X notriesO . $$ add # attempts student permitted 

^assistO * > $$ add: instr— for instructor assistance OR ' 

$$ add: answer-^rrect answer given OR none 
posOpos+ ( lines X 100) ' $$ copy as is ' . . 

pes + 200 copy as is 

$$ $$ r first $$ with desrred specs 

drive 16 $$ copy as is 

nextnow remed=0,x,otheru, $$ r otheru with name remed unit 
goto ansok,drive14,drivef8, ' $$ copy as is 

concept catext $$ copy as is 

concept altl SS copy as is (delete if not used) 

concept alt2 $$ copy'as is .(delete if not used>. 

concept a!t3 $$ copy as is (delete if not usaJ) 

concept alt4 $$ copy as is (delete if ndtojsed) 

concept alts $$ copy as is (delete 4f not used) 



arrow 
specs 
join 
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'Table It 

MONIFORM? (Completed) Constructed Response 



unit ymamev ^ , 

define form1 ' - 
zero v(offset),79 
calc pos<3=2210 ' • . ^ 
vocabs yrname 

<it,ls,it7s,the,state,of> • 
{catext,de!aware,dei,de) 
{aitl,pa,pennsyivania) 
(art2,nj,new*jer$ey) 
(ait3,ny,new*york) 
(ait4,va,virgirria) 
(ait5,md,maryiand) 
write <at,pos> What was the first state to join the U.S.? . 
calc lines <5=1 . , 

^pack temp,patext,Delaware 
pack temp,caf,A small but powerful state. / ,^ 
pack ' temp,taf Jhey were second In the Union, 
pack temp,taf2 Jhat's known as the Garden Stafe. ' , 
pack ' temp,taf3 Jhe ^mpire State could not be firsj. ^ 
pack <emp,taf4,Virginia Is for lovers, 
pack temp,taf5;Spird's home doesn't make It. 
pack ' temp^watlt's located in the East on the ocean, 
pack ' temp,waf2,lt's the second,.smanest state, 
pack temp,waf3,lt has a river.named after it. 
' . pack*^'' temp,wpf4,lt's between- PaJ^JJ, and Md-. 
calc notries<>6 

' ntaf<!=4 ; ' ^ 

assist <5=instr 
pos <5= pos+(linesx10 0) 
pos+200 

nomark^bumpshift . 
driveie. _ ^^^^ 
remed=0,x,review, ' 
ansok,dtive14,drive18,. 

catext ^- X 



arrow 
specs 
- join 
nextnow 
gpto 
concept 
concept 
concept 
concept 
concept 
concept 




Table 12 



Unit Setup 



unit 
rdefine- 

jump 
use ^ 



setup : 
form2 
offset = 50^ 
form' " . 
hum9,definea 



$$ you may specify another number \ 
$$ r forrn with name of your 1st uqit 
$$ used with all moniforms 



*NOTICE: Place a star (*) in front pf any -use- statement, 
*below, not necessary for ^xecutigo^of the M0N:1F0RM(S)' 
*you are using in .your l([Kn. This will save you ecs: 
*{po not delete since yoLrrn3y use them in later MONIFORMS.) 



use 
use 
use 
use 
use 
use 



'drivea 
driveb, 
drivec 
drived 
drivee 
drivef 



$$ usfed with moniformsj ,2,3,4,5,6,7,9 

$$ used with moniformsl ,2,3,4,5,6,7 

$$ used only with moniformS 

$$ usedi'Only with^ moniformS 

$$ used only with moniformsS and 9 

$$ used only with rinoniform9 \ 
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. . ' RESULTS ^ ' • - 

. in general, MONIFORMS ha<re met, the objective^ successfully. The following discus- 
f jsioQ, covers^ tfie six objectives IjSted' earlier in this report. ' • - ^ . 

' , 1. MONIFORMS are responsive to users' needs. Examination of lessons prepared by 
ARPA users employing conventional meam shows several examples of material that could 
have been prepared more easily and quickly by using M0NIF05:MS. Unfortunately, much 
of the lesson n^aterial prepared at ARPA PLATO installations* haH already been ^written 
9nd coded prior to the availability of MONIFORMS^. As a consequenbe, MONIFORMS ' 
' haye received only limited use at ARPA PLATO sites: However, ahnbst all of the ARPA ' 
sites have expressed considerable interest infusing MONIFORMS for future lessoft , 
development. Precise data concerning the use of MONIFOBMS by the general PLATO 
audience are not available. It is knovm, however^ that several PLATO sites have used 
MONIFORMS. To date, Lesson MONIEORM had been accessed 396 times. In several 
cases tli'e lesson has been accessed by the same individuals more than once^j'^ich 
indicates more than a passing interest in MONIFORMS and their use. % '* 

2. MONIFORMS cover the majority of frequently used question types . Examination 
of a considerable amount of PLATO lesson material demonstrates that m'ultiple choice, 
constructed response, and matching-type questions represent, a significant amount of the 
lesson material preplared for^the' PLATO system. MONIFORMS are very useful for these 
^pes of questions because* they offer the user considerably freedom in stfucturing his 
questions and response analysis to meet his particular requirements. 

3. MONIFORMS greatly reduce question preparation time . There is no doubt that 
instruction covered by MONIFORMS can be coded into the PLATO systepi more quickly 

' by using MONIFORMS than by using conventional methods. The average inexperienced ' 
author can code a question with any MONIFORM in approximately 10 minutes or less. 
The time required to code a question by conventional methods would depend upon the 
type of question to be^coded. A multiple choice question where answer alternatives were 
presented in random order took three HumRRO researchers with one month of TUTOR 
programming experience 2-5 hours to code by conventional methods. It required only 
7-12 minutes fpj tjfiem to code the same question using a MONIFORM. 

Specific data tor conventional coding of constructed response and ipatchiifg 
^ questions were not collected because these are more difficxilt types "of questions to code. 
Thus, the time required for coding would be greater th^ih the 2-5 hours required 'for the 
multiple choice question. As a matter of fact, it is likely that the inexperienced author 
would be unable to code the matching-type questions without considerable assistance. 
Even for the experienced author it would require 4 or more hours to code the niatching 
questions by conventional methods as compared to 10 i^inutes by MONIFORM. There- 
fore, using MONIFORMS can greatly reduce question preparation time for both 
experienced and inexperienced authors. 

4. TUTOR programming experience is not' required for completionr of 
MONIFORMS . Knowledge ol TUTOR programming is not needed for MONIFORM 
ccfmplefion The user needs to know only basic PLATO editing commands such as 
'"copy," "replace," and "insert," to complete any MONIFORM. PLATO editing skills 
sufficient to permit "an author to complete any MONIFORM can be acquired within a, 
few minutes. For example, the author of this report has observed individuals, who had 
previously not seen the PLATO terminal and had no TUTOR programming knowledge, 
complete MONIFORMS within 20 minutes. 
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The fact that TUTOR programming ;^xperience is not required fq^ MONIFORM 
completion may have considerable significance in cases where ateain approach is used for 
les§on development. In these cases ani.author mjght prepare* his qtiestidns on paper and . 
have a -secretary input' tliem into the computer. Also, with the team approach, the 
number of skilled TUTOR programmers "necessary can probably be reduced if 
MONIFORMS are used. Since material covered by MO][«FORMS can be coded by 
unskDled personnel -there would not t>e the need for as many skilled programmers; or 
novice programmers could be put to immediate productive use/ Skilled programmers^ 
could be. useji only for cdding material not covered by MONIFORMS. Eventually th^ 
could increase the oyer^ quality of in^bructional material inasmuch- as, the skiUad 
pr6graminer would have more tirhe for coding more sophisticiated material. 

5. Material prepared' .with > MONIFORMS .can be, combined with conventionally 
-' coded material . By design, MONIFORMS are uied for creation of independent uniti^of 

instruction that can be conjibined with units prepared without MONIFORMS. Therefore, 
MONIFORMS in no way dictate the overall structure of an author's lesson. He wouW use ^ 
MONIFORMS only in thote portions of the overall lesson where ttte material prepared 
with MONIFORMS meets his instructional objectives. Actually, it is highly recommended 
that MONIFORMS not be used f^>r the preparation of an entire lesson. At thi§ point, 
available MONIFORMS cover only relatively simple .questions and response analyses. If an 
entire lesson were composed of this material, ^it would probably not be interesting tor the 
student .and certainly would not take full advant^e' of the capabilities of the 
PLATO system. 1 ' 

6. ' MONIFORMS are economical.of author computer lesson space . MONIFORMS are 
extremely economical of the PLATO lesscfn space assigned the author. Approximately 
80-90% of the^yUTOR code (subroutines) necessary for question execution Presides in 
HumRRO lesson space. The subroutines themselves are not resident in the author's lessoa 
space. Also, many of the subroiitipkes are used in several of the MONIFORM^. This, plus 
the fact that all authors using MONIFORMS are using the same subroutines for questiqfn 
execution, results in a considerable savings in overall computer lesson ^ace reqiiirements. 
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/ / ' . ' DISCUSSION^^ . . * ^ 

IMPLICATIONS FOR FUTURE. RESEARCH / : ... ' 

* . '^I'" - • 

It has -been demonstr^ed that the nine^presMtl^' av^ilabfe MONIFORMS are valu- 
able toojis for rapid development of certain frequenftj" used CAI niaterials. However, there 
is a need for continuing ac^ivi|y in MPNIFORM development in the foDowing areas: 

(1) There are a number of other question . types that would lend themselves tb 
MpNIFORMS.^For example;;/ 

* (a) Numericail manipulatio.n.questionf.^^ . ^ - ^ 

^ . (b> RS^king questions. * ' ' 

(c) Multiple choice questions with multiple correct answers. 

(d) Mulf!fple» choice questions in wKicH the student is branched depending 
uj^on'th^ specific response giver^jt 

j(e) Q6e$tions' that' employ the #fcATO touch panel as a means of 
accepting the student's respori^;^ 
' . (2) MONIFORMS presently do jiot pex^t on-line collection' of data concerning 
individual performance on specific questions, ^^erpf ore, it is iiifficult to assess the 
instructional value . of material prepared with ^blNIFORMS, and generally it is not 
feasible to use MONIFORMS for creation of quS^ question^. A data collection package 
could be developed . which authors woutd have the Option of appending to their 
MONIFORMS. This package would greatly strengthen the value of MONIFORMS at 
relatively little cost. ' , '^^ .^fe^ ' 

(Sf In most MONIFORMS the length pfleed))ack messages is limited to 40 
characters. User reports, indicate longer feedbac^ would be desirable. The method has 
already been developed, for permitting authors have feedbacks of any desired length. 
Implementation would involve only a small? additional effort. ^ 

(4) MONIFORMS can be described as a first^generation of HumRRO authoring 
aids for 'the PLATO IV system. They ar^ partia^y completed coding formate^j|tot the 
aujbhor copies into' his lesson and completes to ,^ate his individual question;*«A I^j^cal 
second genferation MONIFOEM would be an inqu%^ system of MONIFORMS. Under^this 
system, rather than^ completing a MONIFORM, PLATO would pose a series of questions 
to the author conceipiing the type of qu.estion /desired, text arid feedback messages, and 
the desired response handling strategy. This type)pf authoring aid would be more difficult' 
to develop than standard MONIFORMS hut jsv^ould be-^even easier for the author 
to complete. * . . , ' 
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Software Subsystem, by the IMPACT Staff, Technical Report 70-22, December 1970. 

^'Theories and Strategies Related to Measurement in Individualized Instruction," by 
Robert J. Seidel, paper for The American Psychological Association Convention, 
. Miami Beach, Fla., September 1970; issued as Professional Paper 2-71, March 1971. 
' (Under joinji sponsorship, with National Science Foundation, Grant No. GJ 774). 

Project IMPAC^T— Computer-Administered Instruction: Preparing and Managing the 

Content of Instruction^ IMPACT Texi^HmMng Subsystem, by the IMPACT st^f, • 
, Technical Report 71-21, September 1971. 

"Current Status of Computer- Administered Instruction Work Under Project IMPACT," 
^by Robert J. Seidel, paper for CONARC Training Workshop, Fort Gordon, Ga., • 
6ctober 1971; issued as Professional Paper 18-72, Jujy 1972. 

Software Documentation Series. Project IMPACT— Computer-Administered Instruction: 
Functions fojrthe Coursewriter III Language, by the IMPACT staff, R§J|arch 
By-Product/pi-71-2, June 1971. ; 

Project IMPACT Software Documentdtion: Overview ofjhe Computer-Administered ^ ^ 

Instruction System, by John Stelzelr and Jean Garneau, Technical Report 72-21, 

August 1972. . ^ • . , . ' 
Project IMPACT Software Documentapon: IL The IMPACT Data Evaluation System— 

Version 2 (IDES-2), by Leslie Willis and John Stelze^ Research Product Dl-72-1, 

Augusf 1972. . / . ' ^ . 

^Project IMPACT Software Documentation: III The IMPACT Data Evaluation System- 
Version 1 (IDES-1 ), by John Stelzer and Leslie Willis, Research Product Dl-72-2, 
.August 197^. ' ' J . - 

Project IMPACT Software Documeritation: IV. The Interface Subsystem Framework for 
Instructional Decision Mqdeling, by William Underbill and John Stelzer, Research 
Product Dl*72.3, August 1972. ^ ^ ' , 

B-oject IMPAQT Software Documentdtion: V. File Activity Control System (FACS), 

by Leslie Willis, Jean Gameau, and John Stelzer, Research Product Dl-72-4, 
. August 1972. ■ • 
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Project IMPACT Software Documentation: VL Volume I, Zeus Functtone and Design 
Concepts, by Jean Gameau and Johfi HMl^r, Research .Product Dl-72-^, August 1972. 

Project lidPA^TSoftwafe Documentation: VL Volume 2, Zeus Program Logle Descrip- 

tions, Jean Garheau, William Undorhill, and Doris Shuford, Research Product 
* Dl-72.5MugUst 1972. 

Project IMPACT Software Documentation: VIL IMPACTS Computer-Administered 

Instruction Software Subsystem, Coursewrlter III, and jts Functions, by Doris Shuford 

and John Stelzer, Reseafch Product Dl-72r6, August 1972. 

# ' • 

Project IMPACT Software Documentation:, VIIL Computer-Administered Instruction 

Computer Program Logic for C0B0L2 Course of Instruction, by Doi^las Spencer, 

Elizabeth Sowell, Leslie Willis, and Jean Gameau, Research Product Dl-72-7, 

August 1972. . ' • 

Project IMPACT Courseware System: Volume l—Innovatlve Procedures for Development 
qnd Administration, by Michael J. Hillelsohn, Technical Report 74-1, February 1974. 

Hardware Technology for Computers In Education: One of the Soluble Problems^ by 
Rpbert J. Seidel, Professional Paper 7-74, May 1974. 

An Axiomatic Theory of Subject Matter Structure, by John Stelzer and Edward H. 
Kingsley, Technical Report 74-14, June 1974. 

Student-Initiated^ Reports: Operational Arialysls In the Evaluation of CAI Currlcuh, 
by Michael j/ffillelsohn. Professional Paper 15-74, September 1974. 

CHARGE Interactive Graphics System Terminal: Theory of Operation, by Ronald J. 
Swallow, Technical Report 74-26, December 1974. • / ^ . 

An Authoring Aid for the' PLATO IV CAI System, by RussellE. Schulz, HumRRO Research 
Product RP:ED.75-6, April 1975. * ' , 




29 



29 



' ^ ' ■ Appendix B ".=^ 

PLATO. CAI INSTALLATIONS SURVEYED 

Behavioral Technology Laboratory, University of Southern Califomiaf Los Angeles, 
Calif pmia. . * 

use/Information Sc-ience Instruction, Marina Del Ray, California. 

Advanced Instructional Systems Directorate, Naval Personnel Research and Qevelopment 
Center, San Diego,'Califomia. 

Institute for ^btthemat^caI Studi^ in the Social Sciences, Stanford iJniversity, Stanford, 
" California; 

«The Rand Corporation, Santa Monica, California. 

c 

ASr F^orifie Human I^esources Laboratory, Technical Training Division, homy AFB,. 
Colorado. . ^ , 

Naval Air Training and ^perimental Command (NATEC), Orlando, Florida* 

CSianute Technical Training Center, Training Research A*pplicatilons. Branch, Chanute Air 
Force Base, Blihois. 

Department of Educational Psychology, University of Illinois, Urbaria, Illinois. 

U.S. Army Ordnance Center and School, Aberdeen Proving Ground, Maryland. 

Computejgzed Training System, U.S. Army Signal Center and School, Fort Monmouth, 
New. Jersey. - ' ^ ^ 

Air Force Human, Reseeurch Laboratory, AST, ^Vri^t-Patterson AFB, Ohio; * 
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Appendix C 
. • ^ , ^ SURVEX, RESP0NSB4 

Not all individuals responded to each question. Therefore, the number of individ- 
uals (N) r^ponding to the follo.wing questions'ranges from 7-12. {The N for each 
question is shown in parentheses.) - ^ 

Give your best estimate of the numi>€r of weeks o£ experience with the PLATO system 
that the average author requires in order to tak«, advantage o% most of the capabilities 
of the system. (N^) 

Mean 

' 20 weeks of experience 

Approximately what percentage of the coding commands nectary for on-line imple- 
mentation of your CAI material is typically written by authors (as opposed to separate 
coders)? (N=10) 

Frequency 

3 100% 

5 75-99% 

0 50-74% 

1 2549% 

1 1-24% ... 

0 0% 

If authonng and programming are^ei:formed by separate individuals in your organization, 
to what extent is communication between the authors and programmers a problem? {N=12) 

Frequency 

5 Not applicable. Authoring and programraing are performed by the same individual 

1 Never a 'problem ♦ • . , 

4 Sometimes a problem * 
0 Frequently a problem 

2 Very frequently a problem 

To what extent do you make use of practice questions i n your operations as a means of 
. monitoring and shaping student performance? (N=12) 

Frequency ' • • 

^ 2 No use 

0 Little use ^ 
0 Some use 
10 E^itensive use ' • 
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* * 

Does lacH of available time for CAI development serioudy affect the number and com- 
plexity of practice questions and response. analysis strategies prepared at your installa- • 
tion? (N=9) • / 

•Frsgusa ; . . • . 

0 Never ^ ^ 

0 Seldom ' * , 

7 Sometimes • 

1 Often 

'1 Very Often ' • 

Do^ lack of CAI aufhoririg or TUTOR programming experience Piously affect th? 
number and complexity of practice questions and response analysis strate^es prepared 
at your installation? (N=10) 

Frequency 

0 Never , ' ^ 
2 'Seldom / . ' 

5 Sometimes 

1 Often V 

2 Very Often 

If practice questions are included in your instructional material, what percent is typically 
of the following types? (Your total should equal 100%.) (N«7) 

Mean (%) * . 

4 True-False ' * 

62 Multiple Choice 

8 Matching ' I 

2 Ranki^i^ 'Alternatives } 

10 Constructed Response (Verbal answer) ? ' 

14 Constructed Response (Numerical answer) ^ 
# ■ 
For which types of pracb'ce questions would authorinjg/programHjing aids be most useful 
to you? Please rank your order of preference, with "1" being assigned to the question* 
type where authoring/programming aids would be most valuable. (N'^S) 

Rank 
^ 5 True-False 

1 Multiple Choice ^ 

3 Matching ' ' . ^ 

4 Ranking Alternatives 

2 Constructed Response (AJphanumeric answer) 

6 Constructed Respoifefe (JJumerical* answer) 



ERLC 



^2 



3Z 



AppendixxD . 

DESCRIPTION of' MAJOR SECTIOI^S 
IN LESSON MONIFORM 

^ Lesson MONIFORM is a lesson designed to assist .autiiors in completing MONIFORMS, 
. Tw6 versions of this lesson ^ available, a CAI version and a programijied text version. 
Readers are encouraged to examine one of botii of ,^ese version^.^ 

A brief description -of the 11 sections of Lresson MONIFOkM follows: • 

(1) IntrcKiuction-^j^l&ins how the lesson should be iis^ an^ 

rationale for MONIFORM use. / ^ ^ . 

(2) Sample Questions--Contains represent^ve sample ques^ons for each 

* MONIFOBLM. The questions give the usar the opportunity m taying out the response 
haftdling capabilities of the MONIFORM. T 

(3) Completed MONIFORMS-Shows the complete MONIFORM for the 
sample questions. , jtf^^ 

(4) Uncompleted MONIFORMS-Are identical to the MdNIFORMS'the user 
copies intoJ^^t lesson. 

^ (5) kONIFORM Characteristics-Describes each MONIFORM to assist the user 
in decidisf if the I^ONIFORM fills his needs, 

(^) How to use MDNIFORMST-Describes briefly the six steps necessary fo:r 
usiii^ MONIFORMS. . 
4 (7) Unit "setup*'HDescribe$ the imit the user copies info his lesson which per- * 

mits the use of HimiRRQ cod^rfcr question execution. 

(3) , Variably Used— ttie variables used for eadi MONIFO^. MONIFORMS 
use PLATb student variables for storing ihe autiior*s tSxt and fecial instructions on how 
the questions are to be executed. These variables are therefore temporarily reserved for 
MONIFORM.use. ^ ^ 

(9) HumRRO Di^ve Units Used— Reference the specific code^rtised vnth each 
MONIFORM, since, in rare instances, an author msiy want, to copy HumRRO code 
(drive imits) into his lesson. 

(10) Assistance With Code^Compl6tion— Provides detailed instructions for the 
comrfetion of each line of code in the MONIFORMS, since' the brief instaructions con- 
tainra on the MONIFORM are sometimes insufficient "for the inexperienced user. 

(117 I>ebngging Your QuestionTpgntaiiis a list of things to check for if the y 
author's question does'not execute correctly. 



^The CAI venion may be examined by tigalng into PLATO Lesson "monifonn.*' The programmed 
text version is.«)ntained in Lesson MONIFORM, An Authoring Aid fm the PLATO IV CAJ System, by 
Russel E. Schulz, HamRRO Research Product RP«ED*76-6, April 197^ 
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